WHAT IS CLAIMED IS: 

1. An image recognition method of processing image 
data of a color image which is represented as 
respective sets of color attribute data of an array of 

pixels, to successively operate on each of said pixels 

lit (TvS-^r r "fo Ju^A *4 /*>< 
as an object pixel f-«*^he^by^et^rmrn-«ig whether said 

object pixel is located on an edge within said color 

image, and thereby derive shape data expressing an edge 

image corresponding to said color image, the method 

comprising steps of: 

eApieaaijiy said sees of color attribute data of 

each of said pixels as respective color vectors- with 

each said color vector defined by a plurality of scalar 

values which are coordinates of an orthogonal color 

space ; 

for each of a plurality of predetermined edge 
directions, generating ^ corresponding edge template" as 
an array of respectively predetermined numeric values; 

extracting an array of color vectors as respective 0 

color vectors off an array of saidjApixels , said /arrayJ'of L iJ Jr 

^ t-tfv ST^^wh « f $ ^ r 
pixels being centered on said object pixel; ^f^^ ^ y /a \^ 

successively applying each of said edge templates 

to said array of color vectors in a predetermined array 

processing operation, to derive edge vectors 

respectively corresponding to said edge directions; 
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comparing the respective moduli of said derived 
edge vectors to obtain a value of edge strength for 
said object pixel, as a maximum value of modulus of 
said edge vectors, and obtaining a possible edge 
5 direction for said object pixel as a direction 

corresponding to an edge vector having said maximum 
value of modulus; and 

judging whether said object pixel is located on an 
actual edge which is oriented in said possible edge 
10 direction, based upon comparing said edge strength of 
said object pixel with respective values of edge 
strength derived for pixels disposed adjacent to said 
object pixel. 

15 2. The image recognition method according to claim 1, 
wherein said step of judging whether said object pixel 
is located on an actual edge which is oriented in said 
possible edge direction comprises comparing said edge 
strength of said object pixel with a predetermined 

20 threshold value and with respective values of edge 
strength of first and second adjacent pixels, said 
first and second adjacent pixels being located 
immediately adjacent to said object pixel and on 
opposing sides of said object pixel with respect to 

25 said possible edge direction, and judging that said 
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object pixel is located on an actual edge which is 
oriented in said possible edge direction when it is 
found that said edge strength of said object pixel 
exceeds said threshold value and also exceeds said 
5 respective values of edge strength of said first and 
second adjacent pixels. 

3. The image recognition method according to claim 1, 
wherein said numeric values constituting each of said 

10 edge templates include positive and negative values 

which are respectively uispuaeu ssynuneLricaiiy opposite 
in relation to said corresponding edge direction within 
said edge template, and wherein said step of applying 
an edge template comprises performing an array 

15 multiplication operation between said edge template and 
said array of color vectors, and obtaining the vector 
sum of a result of said array multiplication operation 
as an edge vector. 

20 4. The image recognition method according to claim 1, 
wherein said step of comparing the moduli of said 
derived edge vectors to obtain said value of edge 
strength of said object pixel comprises: 

based on results of said comparison, selectively 

25 determining that said moduli have a first relationship 
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whereby there is only a single maximum one of said 
modului, a second relationship whereby all of said 
moduli have an identical value, or a third relationship 
whereby a plurality of said moduli are greater than 
5 remaining one(s) of said moduli; 

when said first relationship is determined, 
registering said maximum modulus as said value of edge 
strength of said object pixel, and registering 
information specifying a direction corresponding to the 

10 edge vector having said maximum modulus as the possible 
edye uixeuLiun of s<iid object pixel; 

when said second relationship is determined., 
registering said identical value of modulus as said 
value of edge strength of said object pixel; and 

15 when said third relationship is determined, 

arbitrarily selecting an edge vector having said 
greater value of modulus, registering said modulus 
value as said value of edge strength of said object 
pixel, and registering information for specifying a 

20 direction which corresponds to said selected edge 

vector as the possible edge direction of said object 
pixel. 

5. The image recognition method according to claim 1, 
25 wherein said step of comparing the moduli of said 



derived edge vectors to obtain said value of edge 
strength of said object pixel comprises: 

based on results of said comparison, selectively 
determining that said moduli have a first relationship 
5 whereby there is only a single maximum one of said 
moduli, a second relationship whereby all of said 
moduli have an identical value, or a third relationship 
whereby a plurality of said moduli are greater than 
remaining one(s) of said moduli; 

10 when said first relationship is determined, 

registering said maximum moauius as said value or eage 
strength of said object pixel, and registering 
information specifying a direction corresponding to the 
edge vector having said maximum modulus, as a single 

15 candidate edge direction of said object pixel; 

when said second relationship is determined, 
registering said identical value of modulus as said 
value of edge strength of said object pixel; and 
when said third relationship is determined, 

20 registering said greater value of modulus as said value 
of edge strength of said object pixel, and registering 
information specifying each of respective directions 
corresponding to each of said plurality of edge vectors 
having said greater value of modulus, as respective 

25 candidate edge directions of said object pixel; 
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and wherein said step of judging whether said 
object pixel is located on an actual edge is performed 
by successively utilizing each of said candidate edge 
directions, until an actual edge is detected or all of 
5 said candidate edge directions have been utilized. 

6. The image recognition method according to claim 1, 
wherein said step of expressing said sets of color 
attribute data as respective color vectors comprises 

10 performing a transform processing operation on each of 
said sets or color at/tritoute data to derive a 
corresponding plurality of scalar values which 
constitute a set of coordinates of a predetermined 
color space. 

15 

7. The image recognition method according to claim 
6, wherein said predetermined color space is an HSI 
(hue, saturation, intensity) color space. 

20 8. The image recognition method according to claim 7, 
wherein said coordinates of said HSI color space are 
obtained in the form of polar coordinates, and further 
comprising a step of converting each said set of polar 
coordinates to a corresponding plurality of scalar 



25 
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values which are linear coordinates of an orthogonal 
color space. 

9. The image recognition method according to claim 8, 
5 wherein said set of linear coordinates obtained 

corresponding to each of said pixels is derived such 
that an intensity value for said pixel is expressed by 
a specific one of said set of coordinates while hue and 
saturation values for said pixel are expressed by other 

10 ones of said set of coordinates, and further comprising 
<a tsLejj uf multiply iuy au leeisL one of said coordinates 
of said set by an arbitrarily determined parameter 
value such as to alter a relationship between 
respective magnitudes of said intensity value and said 

15 hue and saturation values. 

10. The image recognition method according to claim 7, 
further comprising a step of converting each of said 
sets of coordinates of said pixels for said HSI color 

20 space to a corresponding set of coordinates of a 

modified HSI color space, such that saturation values 
expressed in said modified HSI color space are modified 
in accordance with corresponding intensity values. 
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11. The image recognition method according to claim 
10, wherein said saturation values in the modified HSI 
color space are decreased in accordance with decreases 
in corresponding intensity values, in relation to 

5 saturation values in said HSI color space. 

12 . The image recognition method according to claim 
10, wherein said saturation values in the modified HSI 
color space are decreased in relation to saturation 

10 values in said HSI color space, in accordance with 
increases in corresponding intensity values from a 
predetermined median intensity value, and ars moreover 
decreased in relation to saturation values in said HSI 
color space in accordance with decreases in 

15 corresponding intensity values from said predetermined 
median intensity value. 

13 . The image recognition method according to claim 
10, wherein said step of converting each of said sets 

20 of coordinates of said pixels for said HSI color space 
to a corresponding set of coordinates of the modified 
HSI color space comprises applying a predetermined 
modification function to each of respective saturation 
values of said HSI color space to obtain modified 

25 saturation values. 
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14. The image recognition method according to claim 
13, wherein said modification function is derived 
beforehand based upon a relationship between the 

5 intensity values and corresponding saturation values 
which are obtained by a transform into an HSI space 
having a specific size, with each of respective hue, 
saturation and intensity values expressed as a specific 
number of data bits. 

10 

15. A mtjLhuu^fjjdtii. i viny £ul a. selected pixel of a 
color image which is formed of an array of pixels, for 
each of a plurality of predetermined edge directions, 
an edge strength value wtykbh corresponds to a specific 

15 one of a plurality of predetermined edge directions and 
is indicative of a degree of probability that said 
selected pixel is located on an edge between regions of 
respectively different color within said image, with 
said edge being oriented in said specific edge 

20 direction, the method comprising a set of steps 
performed for each of said edge directions of: 

expressing the^color attributes of each of said 
pixels of said color image as a plurality of scalar 
values representing a color vector within an orthogonal 

25 color space; 
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obtaining a first weighted vector sum of a first 
set of pixels which are located adjacent to said 
selected pixel on one side thereof with respect to said 
specific edge direction and a second weighted vector 
5 sum of a second set of pixels which are located 

adjacent to said selected pixel on an opposite side 
from said first set with respect to said specific edge 
direction, and deriving the vector difference between 
said first and second weighted vector sums; and 
10 obtaining the modulus of said vector difference, 

and a step of judging the respective moduli 
thereby obtained respectively corresponding to said 
predetermined edge directions, to obtain said edge 



16. An image recognition method for operating on shape 
data expressing an original region image to obtain 
shape data expressing a region image in which specific 
small regions have been eliminated, comprising 
20 repetitive execution of a series of steps of: 

selectively determining respective regions of said 
original region image as constituting a set of small 
regions which are each to be subjected to a region 
combining operation; 



strength value as 




largest one of said moduli. 
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selecting one of said set of small regions as a 
next small region which is to be subjected to said 
region combining operation; 

for each of respective regions which are disposed 
5 immediately adjacent to said next small region, 

calculating a length of common boundary line with 
respect to said next small region, and determining one 
of said immediately adjacent regions which has a 
maximum value of said length of boundary line; and 
10 combining said next small region with said 

adjauenL region having the maximum lengtn of common 
boundary line. 

17 . The image recognition method according to claim 
15 16, wherein said step of determining said set of small 

regions which are each to be subjected to a region 
combining operation is performed based upon judgement 
of respective size values of each of said regions of 
said color image. 

20 

18. The image recognition method according to claim 
16, wherein said step of determining said set of small 
regions which are each to be subjected to a region 
combining operation is performed by selecting each of 
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said regions of said color image having an area which 
is less than a predetermined threshold value. 

19. The image recognition method according to claim 

5 16, wherein said step of selecting one of said set of 

small regions as a next small region to be subjected to 
region combination is performed by selecting an 
arbitrary one of said set of small regions. 

20. The image recognition method according to claim 
xb, wherein said step of selecting one or said set: ot 
small regions as a next small region -ho he subjected to 
region combination is performed by selecting the 
smallest one of said set of small regions. 

21. The image recognition method according to claim 
16, wherein said step of selecting one of said set of 
small regions as a next small region to be subjected to 
region combination is based upon the respective sizes 
of said set of small regions. 

22. The image recognition method according to claim 
16, wherein said step of selecting one of said set of 
small regions as a next small region to be subjected to 

25 region combination is based upon the respective total 
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sizes of sets of regions which are located immediately 
adjacent to respective ones of said set of small 
regions. 

5 23. The image recording method according to claim 1, 

further comprising a step of converting said shape data 
expressing said edge image to shape data expressing a 
corresponding region image, and repetitive execution 
of a series of steps of: 
10 determining all regions of said original region 

image WuiCn eacn nave a size umL ib beiuw <a 
predetermined threshold value, as constituting a set of 
small regions which are each to be subjected to region 
combination; 

15 selecting one of said set of small regions as a 

next small region which is to be subjected to said 
region combination; 

for each of respective regions which are disposed 
immediately adjacent to said next small region, 

20 calculating a length of common boundary line with 

respect to said next small region, and determining one 
of said immediately adjacent regions which has a 
maximum value of said length of boundary line; and 
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in 

combining said next small region with said 
adjacent region having the maximum length of common 
boundary line. 

5 24. The image recording method according to claim 6, 
further comprising a step of converting said shape data 
expressing said edge image to shape data expressing a 
corresponding region image, and repetitive execution 
of a series of steps of: 
10 determining all regions of said original region 

Iiudyc wTixOii cdOli iiaVts a &i2,c i-iiciL xt» Lit: lu w a 

predetermined threshold value, as constituting a set of 
small regions which are each to be subjected to region 
combination; 

15 selecting one of said set of small regions as a 

next small region which is to be subjected to said 
region combination; 

for each of respective regions which are disposed 
immediately adjacent to said next small region, 

20 calculating a length of common boundary line with 

respect to said next small region, and determining one 
of said immediately adjacent regions which has a 
maximum value of said length of boundary line; and 



combining said next small region with said 
adjacent region having the maximum length of common 
boundary line. 



5 25. An image recognition apparatus for processing 
image data of a color image which is represented as 
respective sets of color attribute data of an array of 
pixels, to successively operate on« each of said pixels 
as an object pixel fui Uitiieby -de-betmiiii ji ij whether said 
10 object pixel is located on an edge within said color 

image, and thclcby derive Shape data CApiebsiny an tuye 

image correspondinq to said color image, the apparatus 
comprising: 

color vector generating means for expressing said 
15 sets of color attribute data of each of said pixels 
as respective color vectors, with each said color 
vector in the form of an array of a plurality of scalar 
values which are coordinates of an orthogonal color 
space; 

20 edge template application means for generating a 

plurality of edge templates each formed of an array of 
respectively predetermined numeric values, with said 
edge templates corresponding to respective ones of a 
plurality of predetermined edge directions, for T^-^^l 

25 extracting an array of color vectors as respective 




said array of color vectors in a predetermined array 
5 processing operation, to derive edge vectors 

respectively corresponding to said edge directions; 

edge pixel determining means for comparing the 
respective moduli of said derived edge vectors to 
obtain a value of edge strength for said object pixel, 
10 as a maximum value of modulus of said edge vectors, for' * °1 

obtaiiiiiiy a putjoiijlt; euye dixeuLion for said object 
pixel as a direction corresponding to an edge vector 
having said maximum value of modulus, and fpr judging 
whether said object pixel is located on an actual edge 



based upon comparing said edge strength of said object 
pixel with respective values of edge strength derived 
for pixels disposed adjacent to said object pixel. 

20 26. The image recognition apparatus according to claim 
25, wherein said operation of judging whether said 
object pixel is located on an actual edge which is 
oriented in said possible edge direction comprises 
comparing said edge strength of said object pixel with 

25 a predetermined threshold value and with respective 



15 




direction, 
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values of edge strength of first and second adjacent 
pixels, said first and second adjacent pixels being 
located immediately adjacent to said object pixel and 
on opposing sides of said object pixel with respect to 
5 said possible edge direction, and judging that said 
object pixel is located on an actual edge which is 
oriented in said possible edge direction when it is 
found that said edge strength of said object pixel 
exceeds said threshold value and also exceeds said 
10 respective values of edge strength of said first and 
second adjacent pixels. 



27. The image recognition apparatus' according to claim 
25, wherein said numeric values constituting each of 

15 said edge templates include positive and negative 

values which are respectively disposed symmetrically 
opposite in relation to said corresponding edge 
direction within said edge template, and wherein said 
operation of applying an edge template is executed by 

20 performing an array multiplication operation between 

said edge template and said array of color vectors, and 
obtaining the vector sum of a result of said array 
multiplication operation as an edge vector. 
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28. The image recognition apparatus according to claim 
25, wherein said operation of comparing the moduli of 
said derived edge vectors to obtain said value of edge 
strength of said object pixel comprises: 
5 based on results of said comparison, selectively 

determining that said moduli have a first relationship 
whereby there is only a single maximum one of said 
moduli, a second relationship whereby all of said 
moduli have an identical value, or a third relationship 

10 whereby a plurality of said moduli are greater than 
remaining one(s) of said moduli; 

v/hsn said first relationship is determined, 
registering said maximum modulus as said value of edge 
strength of said object pixel, and registering 

15 information specifying a direction corresponding to the 
edge vector having said maximum modulus as the possible 
edge direction of said object pixel; 

when said second relationship is determined, 
registering said identical value of modulus as said 

20 value of edge strength of said object pixel; and 
when said third relationship is determined, 
arbitrarily selecting an edge vector having said 
greater value of modulus, registering said modulus 
value as said value of edge strength of said object 

25 pixel, and registering information which specifies 



that a direction corresponding to said selected edge 
vector is a possible edge direction of said object 
pixel. 

5 29. The image recognition apparatus according to claim 
25, wherein said operation of comparing the moduli of 
said derived edge vectors to obtain said value of edge 
strength of said object pixel comprises: 

based on results of said comparison, selectively 

10 determining that said moduli have a first relationship 
whereby there is only a single maximum one of said 
moduli a second relationship v/hereb" all of said 
moduli have an identical value, or a third relationship 
whereby a plurality of said moduli are greater than 

15 remaining one(s) of said moduli; 

when said first relationship is determined, 
registering said maximum modulus as said value of edge 
strength of said object pixel, and registering 
information specifying a direction corresponding to the 

20 edge vector having said maximum modulus, as a single 
candidate edge direction of said object pixel; 

when said second relationship is determined, 
registering said identical value of modulus as said 
value of edge strength of said object pixel; and 
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when said third relationship is determined, 
registering said greater value of modulus as said value 
of edge strength of said object pixel, and registering 
information specifying each of respective directions 
5 corresponding to each of said plurality of edge vectors 
having said greater value of modulus, as respective 
candidate edge directions of said object pixel; 
and wherein said operation of judging whether said 
object pixel is located on an actual edge is performed 
10 by successively utilizing each of said candidate edge 
direuLiuiia, until an actual edge is detected or ail ot 
said candidate edge directions havp been utilised. 

30. The image recognition apparatus according to 
15 claim 25, wherein said operation of expressing said 

sets of color attribute data as respective color 
vectors is executed by performing a transform 
processing operation on each of said sets of color 
attribute data to derive a corresponding plurality of 
20 scalar values which constitute a set of coordinates of 
a predetermined color space. 

31. The image recognition apparatus according to claim 
30, wherein said predetermined color space is an HSI 

25 (hue, saturation, intensity) color space. 
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32. The image recognition apparatus according to claim 

31, wherein said coordinates of said HSI color space 
are obtained in the form of polar coordinates, and 

5 wherein said color vector generating means further 

comprises means for converting each said set of polar 
coordinates to a corresponding plurality of scalar 
values which are linear coordinates of an orthogonal 
color space. 

10 

33. The image recognition apparatus according to claim 

32, wherein said set cf linear coordinates obtained 
corresponding to each of said pixels is derived such 
that an intensity value for said pixel is expressed by 

15 a specific one of said set of coordinates while hue and 
saturation values for said pixel are expressed by other 
ones of said set of coordinates, and wherein said color 
vector generating means further comprises means for 
multiplying at least one of said coordinates of said 

20 set by an arbitrarily determined parameter value to 
thereby alter a relationship between respective 
magnitudes of said intensity value and said hue and 
saturation values. 



25 



125 



34. The image recognition apparatus according to claim 
31, wherein said color vector generating means further 
comprises means for converting each of said sets of 
coordinates of said pixels for said HSI color space to 
5 a corresponding set of coordinates of a modified HSI 
color space, such that saturation values expressed in 
said modified HSI color space are altered in 
accordance with corresponding intensity values. 

1° 35. The image recognition apparatus according to claim 
34, wnerem said saturation values in the modified HSI 
color s n ?.C6 ar? decreased in accordance with decreases 
in corresponding intensity values, in relation to 
saturation values in said HSI color space. 

15 

36. The image recognition apparatus according to claim 
34, wherein said saturation values in the modified HSI 
color space are decreased in relation to saturation 
values in said HSI color space, in accordance with 
20 increases in corresponding intensity values from a 

predetermined median value, and are moreover decreased 
in relation to saturation values in said HSI color 
space, in accordance with decreases in corresponding 
intensity values from said predetermined median value. 
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37. The image recognition apparatus according to claim 
34, wherein said operation of converting each of said 
sets of coordinates of said pixels for said HSI color 
space to a corresponding set of coordinates of the 
5 modified HSI color space is executed by applying a 
predetermined modification function to each of 
respective saturation values of said HSI color space to 
obtain modified saturation values. 

10 38. The image recognition apparatus according to claim 
3 7, wnerein said moaitication function is derived 
beforehand based upon a relationship between the 
intensity values and corresponding saturation values 
which are obtained by a transform into an HSI space 

15 having a specific size, with each of respective hue, 

saturation and intensity values expressed as a specific 
number of data bits. 

39. An image recognition apparatus for operating on 
20 shape data expressing an original region image to 

obtain shape data expressing a region image in which 
specific small regions have been eliminated, 
comprising: 

small region detection means for selectively 
25 determining respective regions of said original region 
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image as constituting a set of small regions which are 
each to be subjected to region combination; 

region combination determining means for 
selecting one of said set of small regions as a next 
5 small region which is to be subjected to said region 
combination; and, 

region combining means for calculating respective 
values of common boundary line between said next small 
region and each of the regions which are located 

10 immediately adjacent to said next small region, for 
determining one ot said immediately adjacent regions 
which has a maximum value of said length of boundary 
line, and for combining said next small region with 
said adjacent region having the maximum length of 

15 common boundary line. 

40. The image recognition apparatus according to claim 
39, wherein said small region detection means comprises 
means for determining said set of small regions which 

20 are each to be subjected to a region combining 

operation based upon judgement of respective size 
values of each of said regions of said color image. 

41. The image recognition apparatus according to claim 
25 39, wherein said region combination determining means 



128 

comprises means for determining one of said set of 
small regions as said next small region to be subjected 
to region combination, by selecting an arbitrary one of 
said set of small regions. 

42. The image recognition apparatus according to claim 
39, wherein said region combination determining means 
determines one of said set of small regions, as said 
next small region to be subjected to region 
combination, by selecting the smallest one of said set 
of small regions. 



43. The image recognition apparatus according to claim 
39, wherein said region combination determining means 
15 determines one of said set of small regions, as said 
next small region to be subjected to region 
combination, based upon the respective sizes of said 
set of small regions. 

20 44. The image recognition apparatus according to claim 
39, wherein said region combination determining means 
determines one of said set of small regions, as said 
next small region to be subjected to region 
combination, based upon the respective total sizes of 
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sets of regions which are located immediately adjacent 
to respective ones of said set of small regions. 

45. The image recording apparatus according to claim 

5 39, wherein said small region detection means comprises 
means for selecting respective ones of said regions of 
the original region image that are smaller than a 
predetermined threshold value as said small regions 
which are to be subjected to region combination. 

10 

46. The image recording apparatus according to claim 
25, further comprising: 

means for converting said shape data expressing 
said edge image to shape data expressing a region image 
15 in which respective regions are separately identified; 

small region detection means for selectively 
determining respective regions of said region image as 
constituting a set of small regions which are each to 
be subjected to region combination; 
20 region combination determining means for 

selecting one of said set of small regions as a next 
small region which is to be subjected to said region 
combination; and, 

region combining means for calculating respective 
25 values of common boundary line between said next small 



130 

region and each of the regions which are located 
immediately adjacent to said next small region, for 
determining one of said immediately adjacent regions 
which has a maximum value of said length of boundary 
line, and for combining said next small region with 
said immediately adjacent region having the maximum 
length of common boundary line. 

47. The image recording apparatus according to claim 
30, further comprising: 

means tor converting said shape dciLd expiessijiy 
said edge image to shape data expressing a region image 
in which respective regions are separately identified; 

small region detection means for selectively 
determining respective regions of said region image as 
constituting a set of small regions which are each to 
be subjected to region combination; 

region combination determining means for 
selecting one of said set of small regions as a next 
small region which is to be subjected to said region 
combination; and, 

region combining means for calculating respective 
values of common boundary line between said next small 
region and each of the regions which are located 
immediately adjacent to said next small region, for 



determining one of said immediately adjacent regions 
which has a maximum value of said length of boundary- 
line, and for combining said next small region with 
said immediately adjacent region having the maximum 
length of common boundary line. 



